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This Hem!:- describes FKOGRAMMAE, a parser for natural language. 

It consists of a language for writing grammar:; in the form of 
programs t and an interpreter which eon use these grammars to 
parse sentences. PROGRAMMAE is one part Of an integrated system 
being written for the computer camprehcnsion of natural language. 
The system will carry on a discourse- in Einglish, accepting data 
statements T answering questions, and carrying out Commands, It 
has a vertically integrated structure, to perform parsing] semantic 
analysis, and deduction concurrently, and to use the results of 
each to guide the course of the entire process. This interaction 
is possible because all three aspects arc written in the form of 
programs. This will allow the system to mane full use of its 
' intelligence ' (including non-linguistic knowledge about the 
subject being discussed) in interpreting the meaning of sentences. 
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I. i SY£fEX FOR [fflDEHSTA«D3MC MTURJlL LARGUA&B 


This paper desribes FRQGRAMMAR., a language for the writing of grammar** 
pftOC-RAHMAR was, designed as an integral part of a system for the computer 

I 

under stand lag of English* The system answers questions, execute* cojtrtnd*, and 
accepts information in normal English sentences,, It uses semantic information ‘ 
and context to understand pronoun references in discourse and to disambiguate 
sentences both grammatically and semantically* To do this it uses a special 
type of representation for both the grammar and the semantics * By representing 
these in the form of programs * It is possible to full use of semantic and 

contextual information in developing an analysis of the sentence, It combine* a 
complete grammatical analysis of the sentence with a ^heuristic understander" 
which uses all of its information about the sentence, the discourse, aod the 
world In finding the meaning of a sentence* 

The purpose of building this system was not to develop an applied system, 
but to explore the problems of grammar, semantics, and logic which must he 

I 

solved for the effective understanding of language. 

The project consists of 5 interrelated parts, of which PROGRAM MM is the 
first. Roughly they can he described as follows: 

t] A system for the grammatical .analysis of input sentences. There hare been 

many different parsing system* developed hy different language projects, 

each "wssd on a particular theory of grammar. The type of grammar chosen 
play* a dectstirs rale in the type of semantic analyst* 'which can be carried 

I 

out, and RROCRAMKAR was designed specifically to fit the type of analysis 

. I 

used in this system* It differs from other grammars in that the grammar 
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itself is written in the form of a program, and the parsing system is in 
effect an interpreter for the language used in writing those programs, 

2 } a grammar of ilnsliah to he used by the system. I have written a fairly 
comprehensive grammar of English as a first appr q xlaa E i o si , following the 
lines of systemic grammar (see Section 11,4), There is one basic criterion 
for the completeness of the grammar, A person with no knowledge of the 
system or its grammar should he able to type any reasonable sentence within 
the limitations of the system's vocabulary and expect it to be understood* 

3] A semantic systea for extracting the meaning of the sentence froa its 
grammatical for® This again Is a combination of a system and a language. 
There are mechanisms for setting up simple types of senaafcic networks and 
using deductions from them as a first phase of semantic anaysis* More 
important, the meaning of a word or construction is also defined in the 
form of a program to be Interpreted in a semantic language. It is this 
aspect of semantics 

which is missing in most other theories, which limit thus elves to a 
particular type of network or relational structure. Part of this must 
include a powerful heuristic prograa for resolving ambiguities and 
leterminiug the meaning of references In discourse. In almost every 
sentence, reference is made either explicitly (as with pronouns) or 
implicitly (as with the word "ton") to objects and concepts not explicitly 
mentioned in that sentence. To interpret these, the program nust have at 
its disposal not only a detailed grammatical analysis (to check for such 
things as parallel constructions}, but also a powerful deductive capacity, 
and a thorough knowledge of the subject it Is discussing. 
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4] A deductive system which can he used hy the semantic system in carrying nut 
the deductions which are necesssary not only far such things as resolving 
ambiguities and. answerUg questions, hut also for the directing of the 
parser* I plan tq use PLiittER, a deductive system designed by Carl Hewitt 
(A*I* Hemo i&a) which it based on a philosophy very similar tu the general 
moo-™ o*. Lnis project, ')e suction is not carried out hy a general procedure 
acting on a set of axioms ar theorems expressed In a formal system of 
logic, instead, each theorem is in the form of a program, and the 
deductive process can he directed hy intelligent theorems, FLAMER is 
actually a language for the writing of those theorems, 

t] A gene rat ire language capacity to produce answers to questions and to ask 
questions when necessary to resolve ambiguities, Cramiestically this U 
much less demanding than the interpretive capacity, since humans cun he 
expected to understand a wide range of responses, and it le possible to 

almost anything in a grammatically simple way* However, it takes a 
sophisticated seauntie and deductive capability to phrase things in a wav 
which is meaningful ami natural In discourse, 

6] A base of semantic knowledge. This must include not only "dictionary 
definitions", hut also an understanding of the subject being discussed. 

Inis will enable the system to make the deductions needed to uvderstand 
what is helot said. This win include both statements U the ''semantica" 
language (equivalent to the traditional dictionary) and detailad PLASHES 
statements which include the practical knowledge cf the world, I would 
like to experiment with more than one field of discourse, but the emphasis 
will he on depth of understanding rather than breadth, it will not try to 


r* 
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deal with tie entire contents of a childrens' encyclopedia, or to treat 
objects as formal items and accept statements on all subjects whatsoever* 
The system will be able Co answer deep questions on a particular subject* 
For example* we might consider a robot with &n eye, an arm, and the ability 
to na q ipuLite simple objects, he would like to be able to say, "tfhy did 
you plot up the green block while you were building the tower In the 
corner?", or "How napy blocks were behind the green one when it was the 
bottom of a three block stack?" {ante the use of " f ojie", "lt H , etc,) and 
to actnally enter into discourse with a sequence of questions, like "is 
there a sphere on the table?" "i^at color is it?" "vhen was it put 
there?" "Were there any towers then?", etc, this will require giving the 
system a detailed model not only of the properties of blocks, hands, 
tables, etc,, but a model of its own mentality as well* It should be able 
to discuss its plans and thoughts, as well as use them. 

Listing these si* aspects of language understanding separately is somewhat 
misleading, as it it the iptarconnection and interplay between them which makes 
the system possible. The parser does not parse a sentence, then hand, it off to 
an interpreter. As it finds each component it checks its semantic 
inteprelation, first to see if it is plausible* then if possible to see if It is 
in accord with the aye Lam'a knowledge of the world., both specific and general* 
This has been done in a limited way by other systems, but I plan to use it as an 
integral part of understanding at every level* The featares of FIKXJRAMMAR are 
important not only in its effectiveness as a parser* but in the way they lend 
themselves to use as part of this complete language process* 
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II * A Description, of FRD&.RAHHAH 


II *1 Introdflction 

PROGRAHMAEt differs from other computer systems for natural language in 
three major Mays., 

First, it Is based on a different type of grammar: sysEemic graa&ar, 
developed by M*A*)£, Dalliduy and others at the University of London {see 
references 2-5)* This is discussed further in Section ir*4* The important 
thing about It is not Its specific form or details, hut the fact that its, 
general bias Is towards seeing language as a system for conveying meaning, not 
as strings of symbols* It of course does manipulate the symbols of language, 
hut in its analysis it makes heavy use of the very special ways la which 
Language systematically organizes and conveys meaning* This emphasis makes It 

r ■ 

much more suitable for Inclusion in a total Understanding system than a more 
strictly formal theory, such a transformational grammar or any of the 
variations of contest-free grammars* 

Second, FKDJEUMMAR. views a grammar as a program, and places great emphasis 
On the process of understanding a sentence, rather than the form of the abstract 
structures underlying it* ThU distinction dues pot give an abstract 
theoretical advantage since any type 0 grammar has the same power, What It does 
allow is the organisation of Knowledge about language into a very concise, 
usable, and efficient form* Most current grammatical theories are expressed in 
the fora of a process* usually a generation process which acts on a set of 
syntax rules, each of which rapresants a simple process of replacement* By 
allowing the grammar to he expressed explicitly In the fora of a program, we can 



additions to more rule—oriecited forms of grammar* It also makes it possible 
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to intermix the grammatical and semantic programs in a more Intimate nay* 
allowing them to work together at each point of the process of understanding. 

Of course this process is not intended as a direct aolel of a process used 

in 

by honans any more than the generation rules of ether theories are believed to 
be actually carried out by a language user* The fact that a program can he the 
best may to structure and convey knowlads® does not laply that the program has a 
psychological reality* It does, however suggest that this type of 
representation may he highly useful and revealing in describing Hunan behavior. 

Third* PaOttfiAMKAS sees Language as a process of luteprstation. A grammar 
is a program for Interpreting sentences, rather than generating them. This 
approach has has a □amber of Important consequences to the entire process of 
linguistic understanding . This is discussed at length in another paper 
{reference 6)* and will not be described in detail here. We will note that it 
makes the 1ntegration of the different levels of Grammar* semantics and 
deduction much simpler by Giving us a coherent way to decide at which of these 
levels each type of linguistic fact is best handled* Many of the problems in 
current linguistic theories result from trying to explain semantic facts at the 
syntactic level. By putting syntax into an integrated system* and by allowing 
semantics to play a real part in sentence interpretation, many facts about 
language bacons much more tractable. 
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ll,Z Grammar and Computers 

Id order to explain the features of PROGRANH KR t we will summarise see* Of 
the principles of grammar ussi la computer Language processing. The basic form 
of most grammars Is a list (ordered or unordered) of "replacement rules/' which 
represent a processs of sentence generation, Each rule states that a certain 
string of symbols {its left side) can be replaced by a different set of symbols 
{its right side}. These symbols include both the actual symbols of the 
language (called terminal symbols) and additional "nun-termInal" symbols* due 
non-terminal symbol Is designated as a starting symbol, and a string of 
terminal symbols Is a sentence If and only If it can be derive! from, the 

I ■'» 

Starting symbol through successive application of the rules. For etaracle we can 
writs Grammar li 


1*1 S -> HP 7P 

L.Z HP -*■ DETEitMlElE-l HOJH 

1*3 VP ^ TEhh/aTHiSSITIVE 

1.4 VF -> liflfl/TRAUSXTIVE itP 

1*5 OETIfiMIHSH -> the 

1.6 KOOK -> giraffe 

1*7 liQUH apple 

1.9 TEHB/IBTHAKSITITS -> dreams 

1*9 VEctVTRAK51T17E eats 


By starting with 3 and applying the list of rules {l.L 1*2 1*5 1 .5 1,4 1*2 
1*7 1,5 1*9], we get the sentence "The giraffe aats the apple," Several things 
are noteworthy here* This is an unordered set of rules, Each rule can be 
applied any number of times at aqy point in the derivation where the symbol 

\ 

appears. In addition, each rule la optional* tfe could just as well have 
reversed the applications of 1*6 and 1*7 to get "The apple eats the giraffe. t 

I 

or hato used 1,3 and 1.8 to get "The giraffe -ireasc/" 


This type of derivation 
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‘1 

can be represented ‘srapnically as; 


i 

' 




TBWtRAKSmre !JP 



DETKF5HI3SR liaiT5t 


the giraffe 


eats 


tne 


apple 


Ve will call thU the par3ins tree for the sentence, and usa the usual 
terminology fgp trees (node, subtrees, laughter, parent, etc.). In addition w* 
will use the lln-juistic teras phrase and. constituent 1 interchangeably to 

refer to a subtree,. This tree represents the "immediate constituent" structure 
of the sentence. 
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II .3 Context-free and Context-sensitive Grammars 

Grammar 1 it an Example of vhafc is called a context-free grammar , The left 

aids of eaoh rule consists of a single symbol* and the indicated replacement can 

occur wne never that symbol is an countered* There are a great natter of 

different forts of grammar which can he shown to he eouLvalant to this one, in 

that they can characterise the same languages* It has teea pointed out that 

they are not theoretically capable cf expressing the rules of inslleh, to 

produce such sentences as* "'John, Sidney, and Shan crlered an afgroll* a ham 

sandwich* and a bagel respectively*' 1 Mach more important, even though they could 

theoretically handle the bulk of the English Language* they cannot do this at 

all efficiently, Consider the simple problem of subject-verb agreement, ¥e 

would like a grammar which generates "The giraffe dr cans.'" and "The giraffes 

dream* ", but not '"The giraffe dream*" or "The giraffes dreams,"* Id a 

contefreu grammar, we can do this by introducing two starting symbols* S/PL 
and S/3G for plural and singular respectively, then duplicating each rule to 

match, For sxanpLe,we would have; 


1 * 1,1 S/PL -> KG/PL TF/PL 
1 * 1*2 S/SG -> 3 G/ 5 G TP/SG 
1*2*1 141/PL -> OSTfiSMIREH NUUM/PL 

1.2.2 JK/9G DETEBMEXKR (TOUH/SG 


1.6.1 JDUH/PL -> giraffes 
1.6*2 SDiiH/SG -** giraffe 
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If we then wish to handle the difference between "I am", "ha is*, ntc, we 
wiiat Introduce aa entire new set of syabols for first-person* This sort of 
duplication propagates nultLplteatively through the srwoar,, and arises In all 

J 

sorts of oases. For example, & question and the corresponding jetatemant will 

have much. in common concerning their subjects, objects verbs, etc., but in a 

■ 

context-free grammar, they *ili in general be expanded through two entirely ‘ 
different sets of symbols. 

One way to avoid this problem if to use context-sensltve rules ■ In these, 
the left side may include several symbols, and the replacement occurs when that 
combination of symbols occurs in the string being generated. 
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II + 4 Systemic Ct rid mar 

we can add suwer to cur grammar with context-sensitve rules whieh , for 
example* in expanding the symbol fERfl/jJTEJlAiSSlTlvii, loch to the preceding syaboi 
to decide whether It is Singular or plural* Ey using such, C 0 mtex t“G a ns 11 \ ve 
rules, we can characterize any language whose sentences car. he listed by a 
deterministic (possibly neverending) process* (i*e. they hare the power of a 
luring machine)* There ia however a problem in implementing these rules* In 
any Wt the simplest eases, the context will not he as obvious as in the simple 
example given. The choice of replacements will not depend on a single word, but 
may depend in a complex way on the entire structure of the sentence* Such 
dependencies cannot be expressed In our simple rule format, and new types of 
rules must be developed* Transformational grammar solves this by breaking the 
generation process down into the context-free base grammar which produces deep 
strue Cure" and a set of transformations which then operate on this structure to 
produce the actual ''surface structure" of the grammatical sentence* We will not 
go into th* details of transformational grammar, but on* basic idea is this 
separation of the complex aspects of language Into a separate transformational 
phase of the generation process* 

Systeatc grammar introduces Context in a more unified way into the 
iajLBdlate-coastituent generation rules. This is done by introducing "features" 
associated with constituents at every level of the parsing tree* 

K rule of the grammar may depend, for example, on whether a particular clause 
is transit It* or intransitive* Tn the examples "Fred found a frog.**" A frog was 
found by fred.", and "dbat did frei find?'", all are transitive, but th* Outward 
forms are quite different* l. com tea transit Its rule which checked for this 
feature directly In the string being generated would have to be quite coaplex* 


Instead, we can allow each syatol to bare additional subscripts, or features 
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which control its expansion* In a way, this is like the separation of the 
symbol SP into HP/PL and JJP/S& in our augementel coutext-free grammar* But It 
is not necessary to develop whole new sets of symbols with a set of expansions 
for each* A symbol such: as CLAUSE may be associated with a whole set of 
features (such as TflAHSlTIVE, iKtEKKXSATlTB „ SUBJEFHCTI7E* OBJE&T-Q’JESTIClS. etc*) 
but there is a single tat of rules for expanding CLAUSE* These rules may at 
various points depend on the set of features present* 

The power of systemic grammar rests on the observation that the 
contest—dependency of naturaL language is centered around clearly defined and 
highly structured sets of features* so through their use a groat deal of 
complexity casi be handled very economically. More important for our purposes, 
there Is a high correlation between these features and the semantic 
interpretation of the const!tuenis which exhibit them* They are not directly 
semantic, but are a tremendous aid to interpretation* A parsing of a sentence 
in a systemic grammar might loot very much like a context-free parsing tree, 
except that to each node would be attached a number of features* 

These features are not random combinations of facts about the constituent, 
but are a part of a carefully worked out analysis of a langmage in terms of its 

■ I Ell 

systems * The features are organised iu a network, with clearly organized 
dependencies, for example, the features IHPHtWlTi; (command) and ISTEEBDttWIVE 

L 

(question) are mutually exclusive in a clause, as are the features POLAR (yes—no 
question like "Did he go?*') and MH-QflKSTIQN (like *Vho went?)* In addition, the 
second choice can be aade only if the choice IMTERhOGATI i E was made in the first 
set, A set of mutually exclusive features is called a "system", and the set of 
other features which must be preseat for the choice to he possible is called the 
"entry condition'' for that system. This Is discussed iu detail in references 4 
and 5, —% 

il j i 


1 
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Another basic concept of systemic grumaar is that of the rani: of a 
constituent. Rather than haring a plethora of different non-terainal symbols, 
each expanding a constituent In a slightly different way, tber^ are only a few 

HI IH 

basic units * each having the possibility of a number of different features, 
chosen from the ""system network" for that unit* In an analysis of English, 

three basic units seam to explain the structure: the CLAUSE, the GROUP, and the 

. 1 

HOED. In general, clauses are made up of groups, and groups made up of words. 
However, through "ranks hi f t", clauses or ^oups can serve as constituents of 
other clauses or groups* Thus, in the sentence "Sarah saw the student sawing 
logs, 1 ' 'the student sawing logs'' is a liDlfK GROUP with the CLAUSE ''sawing logs' 4 
as a constituent {a modifier of "student'*)* 

IP "II H |p p| 

The constituents who t three lays , some of the man on the board of 
directors” and "anyone who doesn't understand me" are all noun groups, 

1 

exhibiting different features* This means that a PRO&RARNAR grammar will hare 
only a few programs, one to deal with each of the basic units* Ky current 
grammar of English has programs for the units CLAUSE, NOUN GROUP, VERB GROUP, 
PREPOSITIONAL GROUP, and ADJECTIVE GROUP. 
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II,5 Grammars as Programs 

Let ns see hDM a grammar as outlined ah&ve c-ould "be written as a program* 
Grammar 1 could be diagrammedi 


DEFINE program SENTENCE 

PARSE a HP -> - —fell? y RETURN failure 



i 

RETURN success 


DEFINE program HP 


PARSE a DSTiRKINEfl -+ 

X 

PARSE a HOUR-i--- 

X 

RETURN SUCCeES 


+RETURN failure 


DEFINE program 7F 


PARSE a TUB-l----RETURN failure 

la It ? 5ANSITI7E7>—» PARSE a NP*—. 

U it iSTRAMSITim-j - -- Jl 

i 

RETURN euccesat--- 



The basic function used Is PARSE, a function which tries to add a 
constituent of the specified type to th* tarsing tree. If the type has been 
defined as a PRDCRAJ4MAR program, PARSE activates the program for that unit* 
siTlng it as input the part of the sentence yet to be parsed, if no definition 
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axitte. PARSE interprets its arguments as a list of features which suet bs found 
In the dictionary deisttion of the next word in tii« sentence, If $o f it 
attaches a node for that word, and removes It from the remainder of the 
sentence, if not, it fails. If a PSOORaMUjUR program has been called and 
succeeds, the new node ie attached to the parsing tree. If it fails, the tree 
It left unchanged. 
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II,6 The Fora of PROtRAHNAR traamars 

Written in PROGRAM^All, the programs would look Ilka: 


2*1 (PDHFKE SEf TENSE 
2*2 (((PASS!! HP) WL FAIL) 

2.3 {{PAASE tp) JAIL FAIL RETURN))) 

2*4 { PDF FINE SF 

2.a {{{PARSE DETERMINER) NIL FAIL) 

2,6 ((PARSE NOUN) JLETURM JAIL))) 

2*7 (POEFISB TP 

2*0 ({(PARSE 7EHB) NIL FAIL) 

2.9 {(ISq H TRANSITIVE) NIL ISTRAUS ) 

2.10 {(PARSE HP) RETURN NIL) 

2*11 INTRASS 

2*12 H INTRANSITIVE) RETURN FAIL))) 


Rules 1*6 to 1*9 would have the foru 

2.13 (DEFPHOP GIRAFFE {NOUN) WORD) 

2.14 (DfifPEQP DREAM (VERS INTRANSITIVE) NORD) 

etc. 


This example Illustrates some of the basic features of PROGRAMMAR. First 
it is embedded in LI&P ± and much of its synla* is LISP syntax* Units, such As 
SENTENCE are defined ae PEUGRARHAK programs of no arguments, Each tries to 
carsa the string of words left to he parsed In the sentence* The exact form of 
this Input string is described in section III*6, The value of {PARSE SENTENCE) 
will he a list structure corresponding to the parsing tree for the complete 
sentence. 

Each time & call is made to the function PARSE* the system begins to build 
a new no-ie on the tree. Since PROG SAMKAI-t programs can call each other 
recursively* it is necessary to keep a pushdown list of nodes which are not yst 
completed (l,e, the entire rightmost branch of the trso). These are all called 
^active” nodes, and the one formed by the most recent call to PARSE is called 

*7 
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the "currently active node". 

Me can examine oar sample program to see the basic operation of tba 
language, Whenever a PSOGELAMM AR program is called directly toy the user, a node 


of the tree structure is act up, and a set of special variables are bound (he* 
section 111.7)* Tim lines of the program are then erscuted in seq.uence, as in a 
LISP PR0&, except when they have the special form of a BKAMStf statement, a list 

I 

whose first member (the CONDITIO?*) is nun-atomic, and which has either 2 pr 3 


\ 


J 



other aenbers, called DI RBCTlOJiS, line 2,3 is a threend irectlon branch, and all 
the other executable Hues of the program are tw P-d.1 rec t ip n branches, 

When a branch statement is Encountered, the condition is evaluated, and 
branching depends an Its value. In a two-direction branch, the first direction 
is taken if it evaluates to non-nil„ the second direction if it is nil- In ft 
three-direction branch, the first direction is taken only if the condition Is 
a&iwiil, aad there i3 more of the sentence to be parsed* If no lore of the 
sentence remains, the third direction IS taken, 

The directions can be of three types. First, there ars three reserved 
Koras, XIL, SETUPS, and TAIL. A direction of SIL sends evaluation to the neit 
statement in the program. FAIL causes the program to return HlL after restoring 
the sentence and the parsing tree to their state before that program was called, 
jIET'LSH causes the program to attach the currently active node to the completed 
parsing tree and. return the sab tree below that nods as its value. 

If the direction Is any other atom, it acts as a GO statement, transferring 
evaluation to the statement immediately following the occurence of that atom as 
a tag. For example, if a failure occurs In Hoe 2*0, evaluation continues with 
line 2.12, If tbs direction, is nOn-atumic, the result is the same as a FAIL,, 
but the direction Is put on a special failure massage list, so the calling 
program can see the reason for failure* y-- 
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Looking at tine programs* we see that SJ3MTEHCE will succeed onlr if it first 
finis a HP, then finds a YP which uses up the rest of the sentence* In tho 
program VP, we see that the first branch statement checks to see whether the 

nest word is a verb. Af 90* it remores it froa the regaining sentence* and goes 
oh, If not, VP fails* The second Btateaent uses the PK05RAMHAR function 15(5, 
one of the functions used for checking features* USQ A 5) checks to see 
whether the node or word pointed to by A has the feature E* H is one of a 
number of special variables used to hold information associated with a node of 
the parsing tree, section III*?) It points to the last word or 

constituent parsed by that program. Thus the condition U$Q 3 TRAflSlTITE) 
succeeds only if the verb just found by PAUSE has. the feature TRARSlTlVS. If 
on, the direction nils, sends It on to the next statement to Ionic for a HP* and if 
it finds one it returns success. If either no such HP is found or the verb is 
□ot Tf£A 1©IH Y£ + control goes to the teg IHTRAMS* and if the verb is 
IflTRAHSITIVTl, the program VP succeeds* Hate that a verb can have both the 
features INT3AHSITI 'IB and. 1 HAd SI TIVE * and the parsing will then depend on 
whether or not an object HP is found. 
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13,7 The Contsit-£eusitive Aspects 

So far, we have don* It tile to go beyond a context-free gramear* Row, for 
ei&aple, can we handle agreesent? Une way to do this would be for the VP 
program to look hack la the sentence for the subject, and check Its agreement 
with the verb before going on, tfe need & way to ellab around on the parsing 
tree, looking at Its structure. In PflQflflAMHAEt ( this is done with the pointer 
PT and the moving function ** 

Whenever the function * Is called, its arguments form a list of 
instructions for moving PT fron its present position. The Instruction list 
contains non-atonic C0JDITI03S and atomic IHSTEBCT 1 0NS * Tha instructions are 
taken in order, and when a condition Is encountered, the preceding instruction 
is evaluated repeatedly until the condition is satisfied. If the conditloo is 
of the form (ATOM), it la satisfied only if the node pointed to by PT has the 
feature ATOM, Any other condition is evaluated by LISP, and is satisfied if it 
returns a non-nil value. Section 111,8 lists the instructions for *, 

Tor example, evaluating {* C U) will sat the pointer to the parent of the 
currently active node. {The mnemonics are: Current., Up) The call (* C OLC PT 
tSP)) will start at the current node, more down to the rightmost completed node 
U»e, not currently active) then move left until It finds a node with the 
feature IIP, (Down-Last-Compieted, Previous), If * succeeds, it returns the now 
value of PT and leaves PT set to that value. If It fails at any point In the 
list, because the existing tree structure makes a command impossible, or because 
a condition cannot b* satisfied, FT is left at its original, position, and * 
returos nil. 

Me can now add another branch statement to the TP program In section 11,6 
between lines 2*9 and £*9 as follows: 

■o 

2*8,1 (tan(A»aSQ(* C ?¥ tffiCjSIMGHH&NlSQ d SIJEIFUH)) 


B 
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2*3. a (JHDdSQ PT PLURAL KI S3 H PLURAL))) 

£,a,3 31L [AGEBlSrtElff)) 

Tbia is an example of a branch abatement with an error message, It moves 
the pointer from the currently active node (the VP) to the previous node {the 
HP) and 4o»n to its last contituent (the noun), It then checks to see whether 
this shares the feature SIHGULAR with the last constituent parsed by TP (the 
verb). If not it checks to see whether they share thB feature PLURAL, notice 
that once PT has been set by * f ft regains at that petition. If agreement is 
found, evaluation continues as before with line 2,9* If not, the program VP 
fails with the message (AGASIS 

So far w* have not made nuch use of features, except on words* AS the 
grainmar gets aore complex, they become much more important* As a simple 
esample, we say wish to augment our grammar to accept the noun groups 

"these fish/ 

"this fish," 

“the giraffes/ 

and "the giraffe/ 

Rut not "these giraffe/ or "this giraffes/ ¥* can no longer check a single 
word for ogreenest„ since "fish" gives no clue to number in the first two, while 
H ttia H gives no clue in the third and. fourth, Humber is a feature of the entire 
noun group, and we must interpret it in some cases Prom the form of the noun, 
and in others from the farm of the determiner. 

! I 

ife Mil rewrite asar pwstme fro hAiidie cdapLsxLtr shown In. (j-rnuAT 

* 


5.1 (PDEFIJfE S&ITESCE 

3.2 (l(PARS£ HPJHIL FAIL) 

3,5 ((PAR3L V?) FAIL EAI1 RZTURK})) 
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> 3.4 (PDSFIKE HP 

3.5 (((AHD{PARSE DSTEflHI3i(R) tfQ DETERKIKED))MIL HIL FAIL) 

3.6 {(PARSE SDUH)HtL TAIL) 

5.7 UCQ OfiTJ£SMINSD)DST SlL) 

3.9 ((TH^ST H (QUOTE(SINGULAR PLURAL)))RETURN FAIL) 

3.9 DEI 

3.10 ((TRHSF H {KEET(7E(* H FT (DETERHINER)}) 

3.11 (QUUT£(SINGULAR PLURAL)))) 

3.12 RETURN 

3.13 FAIL))) 

■ 3.14 (PDEEIKE ?F 

3.15 {{(PARSE TERBJXIL FAIL) 

3.16 ((KE5T(FE d)(P£{* C Pf {NP)))(QUGTE{SIKGGLAR PLURAL))) 

3*17 HlL 

3.18 CASREEMEtT)} 

3.19 ((ISQ H TRASS3TIV£)HIL IHTRAN5) 

3.20 ({PARSE HP}RETURN NIL) 

3.21 {{I5Q. 3 IRTRANSITIVE)RETURN FAIL))} 

We Rave used Che FROGRAMMAii functions TQ an A TRRSF, which attach features 
to Constituents, The effect of evaluating (FQ A) is to aid the feature A to the 
1 List of features for the currently active node of the unreins tree. TRHSF is 
used to transfer features from another node to the currently active node. Its 
first argument is a pointer to the node froa. which information Is to ha 
transferred, The second is a list of features to be locked for. Tor example, 
line 3.8 looks for the features SINGULAR and PLURAL ir. the last constituent 
parse! {the flOUH), and adds whichever ones It finds to the currently active 
node, The 'Branch statement beginning with line 3.10 is more complex. The 
function * finds the DETfiRMIHER of the MP being parsed. The function TR finds 
the list of features of this node, and the function KEET intersects this with 
the list of features (SINGULAR PLURAL). ThU intersection la then the set of 
alienable features to be transferred to the UP node from the NOUN, Therefore if 
there is no agreement between tha HOUR aqd the DETESTINER, TRUST fails to find 
any features to transfer, and the resulting failure causes the reaction of such 
phrases as "these giraffe," 

In line 3.7 we use the function LQ which checks for features on the current 
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uode* {CQ DjfTiEtill RmD) will be non-nil only if the current node has the feature 
DETERMIMISD* (lit, It wa.e put there in line 3*5) Therefore a noum group with a 
determiner is cartel with. the feature DET3RKI1I2D, and U also given feature? 
oorrrespending to the intersection of the number features associated with the 
determiner if there is one + and the noun, notice that this grammar can accept 
noun groups without determiners, as in ''Giraffes eat apples,‘ r since line 3*£ 
fails only If a DETERMINER is found and there ere no more words in the sentence* 
In conjunction with the change to the HP program* the 7F program aunt be 
modified, to check with the HP for agreement. 

The branch statement beginning on Line 3.15 does this by pairing sure there is 

dl 

a number feature common to both the subject and the verb* 

This brief descr1ptinn explains soma of the basic features of PSQGRAtfHAR, 

In a simple grammar, their importance is not obvious, and indeed there seem to 
be easier ways to achieve the 5 Arne effect* As grammars become more complex t 
the Special aspects of PRQ&flAMMAR become more and acre important, and I plan in 
another paper to describe the PROGRAHKAR graemar for ingish which is used by 
the understander system. 

A cumber of the other features a n i details of PROSDAMMAR am described In 


Section III, 
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11.a Ambiguity and Underatandij!^ 

Headers familiar with parsing systems may by now hare wondered about the 

I 

problem of ambiguity, As explained, a PfiOBBAWMAfl program trie* to find a 
possible parsing for a sentence* ani as toon at it succeeds, it returns its 

I. 

answer. This Is not a defect of the system* but an active part of the concept 
of language for which it was designed* The language process t? not segmented 
ipto the operation of a parser, followed by the operation of a semantic 
Interpreter. Rather* the process is unified* with the results of semantic 
interpretation being used to guide the parsing. This is very difficult in other 
farms of grammar, with their restricted, types of context-dependence. but it is 

■ Jl 

straightforward to implement In PROG RAM MM, For eraaple t the last statement in 
a program for HP may he a call to a noun-phrase semantic interpreter. If it is 
impossible to interpret the phrase as it is found, the parsing is Immediately 

K 

redirected. 

The way of treating ambiguity is not through listing all 1,243 possible 
Interpretations of a sentence* but in being intelligent in looking for the first 
one* and being even more intelligent in looking for the next one If that fails. 
There is nc automatic backup mechanism in PrOGsaHHAH, because hlind automatic 
backup is tremendously Uefficent. A good PR0GRAHMAR program will check itself 
when a failure occurs, and Eased on the structures it has seen and the reasons 
for the failure* it will decide specifically what should be tried next. This is 
the reason for internal failure-messsages* and there are facilities for 
performing the specific backup Steps necessary* (See section HI.4) 

As a concrete example, we might haye the sentence "I rode down the street 
in a car* At a certain point In th# parsing, the RF program may come up with 

|| .|,|i 

the constituent the street in a car * Before going on, the semantic analyser 
will reject the phrase "in a car” as a possible modifier of “street”, and the 
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program will attach It instead aa a nodiTier of the action represented by the 
sentence, Since the semantic system is a part of a complete deductive 
understander, with a definite war 1<L—mode 1, the semantic evaluation which guides 
parsing can include 'Doth general knowledge (cars don' t contain streets) and 
specific knowledge (Melvin owns a red car, for sxanple). Kunans take advantage 
Of this sort of knowledge In their understanding of language, and It has been 
pointed out by a number of linguists and. computer scientists that good computer 
handling of language will not be possible unless computers can do so as veil* 
Tery few sentences seen ambiguous to humane when they first hear them* 

They are guided by an understanding of what is sail to pick a single parsing and 
a very few different aeanlngt, By using this sane knowledge to guide Its 
oarsiagj a computer understanding system could take aivantage of the same 
technique to parse meaningful sentences quickly and efficiently. *e must be 
careful to distinguish between grammatical and semantic ambiguity, Although we 
want to choose a single para Lag without considering the alternatives 
simultaneously, we want to handle semantic ambiguity VEry differently. There 
may be several Interpretations of a sentence which are all more or less 
neanlngful, and the choice between them will depend on a complex evaluation of 
our knowledge of the world, of the knowledge the person speaking has of the 
world, and of what has been said recently. This is particularly true in cases 
of ambiguous pronoun reference* For example, if the system were asked the 
sequence of questions! Is a green block on a table? Vh&C color Is it? we 
would expect "it" tn refer to the table. If asked "is a block on a green table? 


ll| tfhat color Is It?*, we know that ‘“it" must refer to the Mock, If the second 
question w«r« "what $Uc is it?” it would be much more ambiguous. To resolve 
! this, we must know that green is a color, and that a person is not likely to ask 


the color of an object if he has Just specified it 


This is the type of 


/ 


1 
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asbiguity dealt with by the system. through its hsurUUc programs and deductive 
sytteau It huvarar is not directly a part of the sraacksr * 

fhie naans that we mist discuss only tines? things th* computer knows about 
and understands fully enough to nanipulate the knowledge necessary for 
interpreting & sentence. The forra of relationships it must ha able to handle 
go beyond simple structures, such as associative networks of links between wards 
or arbitrary relational statmeats in the predicate calculus. Just hov much is 
necessary is a deep problem« and I plan to |discuss It more in reference to other 


parts of the systei. 
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11*9 Sanaa .it 

Ld understanding the reason for developing PROGRAJ4MAH, several factors are 
iuportant, The first is that only through the flexibility of expressing a 
grammar as a program can we introduce the type of intelligence necessary for 
complete language understanding* PROSRAMMAR is able to take into account the 
fact that language is structured in order to convey Mining, and that our 
parsing of sentences depends intimately an our understanding that leaning* 
PROGRAMar. can take advantage of this to deal more efficiently with natural 
iattsuaga than a general rule-based system, whether context-free or 
^transformational, Hare important, the analysis returned by PSQGRajWaR is 
designed to serve as a part of a total understanding process, and to lend itself 
directly to semantic interpretation. This was cue reason for selecting systemic 
graamar, and has guided much of the design of the system. The exact way in 
vhich semantic interpretation can he done, and the reasons why a systemic 
analysis Is important will be discussed in later papers on the semantic aspects 
of the system* 

A reasonably comprehensive grammar of English has been written in 
FROG.ELAMflAJl, and it is able to parse unite complex sentences* It is being used 
as a part of the system, which is currently being debugged. 

Soma examples of English sentences parsed hy PROGSAXKJlE are included in 


Section Ilf, 
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III Detail* of the PfflWKiMMJL't LuCQifii 


I3I.1 Operation of the System 

Since the grasraar is itself a program* there Is not much overbsad mechanism 
needed far the basic operation of the parser. Instead, the system consists 
mostly of special functions to be used by the grammar* The system maintalcs a 
number of global variables, and keeps track of the parsing tree as it It built 
by the roaiw function, PARSE* When the function PARSE is called for a UStT which 
has been defined as a PfiflCRAMMAR program, the system collects information about 
the currently active node, and saves it on a pushdown list. It then sets up the 
necessary variables to establish a new active node, and passes control to the 
FRG&iLWAjt program. for the appropriate unit* If this program succeeds, the 
system attaches the new node to the tree, and returns control to the nod; ou the 
top of the FDL. If it fails, it restores the tree to its state before the 
program was called, then returns control* K PRQGSAKHAR program is actually 
converted by a si&ple compiler to a LIS? program and run In that fora* The 
*artables and functions available for writing FBDfilUM programs are described 
la the rest of part III. Sections ni.l to III.5 explain special features of 
the language* Sections III.6 to III.9 are more io the style of a manual which 
would allow the reader to understand PR03RAMHA3 programs. 

When the function PARSE is called with a first argument which has not been, 
defined as a PflD&itAHM AR program, it cheeks to see whether the p-xt word, has all 
of the features listed lit the arguments, if so, it forms a new node pointing to 
that word, with & list of features which is the Intersection of the list of 
feature* for that ward with the allowable features for the word class indicated 
by the first argument of the call, ior example, the word "blocks" will have the 


FAQGRAHMAR II1,1 page 29 


possibility of being either a plural noun or a third-person-sinsular 
prosent— truss verb* Therefore, before any pursing It will have the features 
(JJDLm YE3B H-PL VB-3PS TRASSIT1YE FR£S£nr), If the expression (FABS& YE.&9 
fRASSITIYE) Is evaluated when "blocks" Is the next word In the sentence to be 
P&rsel t the feature list of the resulting node will be the intersection Of this 
combined list vith the list of allowable features for the wori-class VERB, If 
we have defined; 

(DEFPiOP IIB {7ERB INTRMSIT3 7E TMRSITIYE PRESET PAST TB-5PS YB-PL) 
RLIM) p 

the new feature list will he (!?ERB TRAIKITIYE PKESEflT VB-3PS1. {ELIM is 

■ |S 

simply a property indicator chosen to indicate this list which ELIMijiates 
features). Thus, even though words may have more than one part of speech* when 
they appear In the parsing tree* they will exhibit only those features relevant 
to their actual use in the sentence* 


4 
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III.2 Special Words 

Some words must be handled in a very special way in the grammar, The nost 
prevalent are conjunctions, such as "and" and "but"* if hen one of these is 
enrcountered t a program should be called to decide what steps should be taken in 
the parsing, This Is lope by giving these words the grammatical features SPEC 
or SPECS* Whenever the functlop PARSE is evaluated, before returning it checks 
the nett word in the sentence to see if it has the feature SpEC* If so, the 
SPEC property on the property list of that word indicates a function to be 
evaluated before parsing continues* This prog ram cap In turn call PB0G &AMMAR 
programs and make an arbitrary number of changes to the parsing tree before 
returning control to the normal parsing procedure, 5PECL has the same effect, 
but U checked for when the function £ARSE is callsa, rather than before it 
returns* Tarious other special variables and functions allow these programs to 
control the course of the parsing process after they have been evaluated, By 
using these special words, It is possible to write anasingly simple and 
efficient programs for some of the aspects of graaaar which cause the greatest 
difficulty. This is possible because the general fori of the grammar Is a 
program* 

p| |p 

For example, and can be defined as a program which is dia*raamed: 
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Farss a uni t of the same type 
the currently active node ’ + 


* Return failure 


I 


Replace the node with a new node 
cpaihlnlnE ths oil one and the one 
you have just found 

. I 

Return success 

For example t given the sentence ’The giraffe ate the apples and peaches." 
the progmcs would first encounter "and' 1 after parsing the JKKIN apples. It would 

- J- 

then try to parse a second HOUR, and would succeed, resulting lq the structure: 

SETCENCtf 


BETErWIflEft 

trn: 



HP 


HS'JH 


mm visits 

I i 

giraffe ate 


DETESMIflER 

I 

the 



[ 



I 


apples and peaches 


If we ha-i the sentence, "The giraffe ate the peaches and drank the vodka* 
the parser would first try the nv thins* However, "irant" is not a HOSJH* so 
the ASD proerna would fail and the BDUK "apples' 1 would he returned unchanged* 
This would cause the UP the apples to succeed, bo the ARD progran, would be 
cal lei again* It would fall to find a RP beginning with ,P (irsi-Jiit"* * so the UP 
"the apples" would be returned* causing the TP to succeed* This tlae, Att) 
would try to parse a VP and would find "Irani the vodka", It would therefore 


cake up a combined VP ar.d cause the entire SENTEKCE to he completed with the 
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structarS: 



The prograa to actually do tMe would take only 3 or 4 Lines in a 
PflQGRArfHAit grammar, In the actual system, It Is tore complei as It Handles 
lists (like "A* E + and. C*) other tonJanetions (such. as "'hut") and special 
constructions ( euch ag "hotH h and B" k ), 


r y 

\ ^ 
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III-3 The Dictionary 

since PKQSHAtfrtAii ifl embedded in LI$t\ the facilities of LISP for hardline 
atom names are used directly. To define a word, a list of grammatical features 
is put on Its property list under the indicator JO HD„ and a semantic definition 
under the indicator SttNTG, Tun facilities are included to arcid haring to 
repeat information for different forms of the same word, first, there is an 
alternate way of defining words, by using the property indicator WORDl, This 
indicates that the word given is an inflected fora, and its properties are a 
modified form of the properties of its root, A HOltfH definition has three 
elements, the root word, the list of features to be added, and the list of 

I 

features to be removed* For example might define the word ’’go” by: (DFPPROP 

GD (tfERF ISTRAHSITITE MOTION ISFIHITIVB) NORD) Ve could then define 'Vent” as 
(DEFFflOF dEJJT (GO {PAST) (IKFIRITIVE)) JQRDi) This indicates that the feature 
INFINITIVE is to he replaced by the feature PAST, but the rest (including the 
semantic definition) is to remain the same as for "go'V 

The ntber facility is an automatic system which checks for simple 
i&odifinations, such as plurals, "-lug," forms, "-sr" and eet'' forms and so 
forth* If the word as typed in is not defined, the program looks at the way it 
is spelled, tries to remove its ending (taking into account rules such as 
changing "ruuniug"' to "run", but "buzzing" to “buzz")* It then tries to find a 
definition for the reduced root word, and if it succeeds, it makes the 
appropriate changes far the ending {such as changing the feature SINGULAR to 
PLURAL), The program which does this is the one part of the PRO£RAMkAR system 
described here which is specifically built for English. Everything else 

J 4_ 

described is designed generally for the parsing of any language. In asv 
particular language* this input fuatioa would have to he written according to 
the special rules of morphogr&pheni c structure. The only reduireneat for such a 


in i 
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program is that its output must be a list, each nss'Eer of which corresponds to a 
vor4 in tie original sentence* &r,d is in the fora described in section 113*5. 
This list is bound to the variable S£KT f and is the way in which PROGfiAHKAR sees 
its Input, 


-“L 
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111,4 Backup Facilities 

As explained tn section H,(S, there la no automatic backup* hut there are a 
number of special facet lone which can be used In writing grammar a. The 
simplest* [POPTO X) simply removes nodes from the tree* The argunent is a list 
of features* and the effect is to remove daughters of the currently active node, 
beginning with the rightmost and working leftword. until one is reached with all 
of those features* [FOP X) Is the sane, except that it also removes the node 
with the indicated features. If no such and# exists* neither function takes any 
action* (POP) is the same as [POP HlL)* and a non-nil value Is returned by both 
functions If any action has been taken. 

A very important feature is the OUT variable. Ona nay to do backup is to 
first try to find the longest possible constituent at any point* then if for any 
reason an impasse Is reached, to return and try again , limiting the consttuent 
from going as far along in the sentence. For example, in the sentence r 'Was the 
typewriter sitting on the cake?", the parser will first find the auxilli&ry verb 

11 H j | 

was * then try to parse the subject. It will find the noun group the 

|| 

typewriter sitting on the cake t which in another context might well be the 
subject ("the typewriter sitting on the cake is broken," 1 ). It then tries to 
find the verb, and discovers none of the sentence is left. To back up. it must 
change the subject. A very clever program would loot at the structure of the 
noun group and would realise that the modifying clause "sitting on the cake" 
must he dropped. A more simple-minded but still effective approach would use 
the following instructions: 

(** N 7d) 

(POP) ■ t 

((CUT PN)SUBJECT (EfifflH}) 

The first command sets the pointer PW to the last word in the constituent 
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tin this case, celte }* The next removes. that constituent* The third. seta a 
special pointer, CUT to that location* then sends the program back. to the point 
where it was looking for a subject* It would now try to find a subjnct again, 
hut would not he allowed to so as. far ae the word ''cake'’. It night now find 
"the typewriter sitting,” an analog to "The can sitting is ay ■uncle*" If there 
were a good semantic program* it would realise that Che verb "sit' r cannot he 
used with an inanimate object without a location specified* This would prevent 
the constituent "the typewriter sit tine” from ever being parsed* Even if tills 
does not happen* the program wBuld fail to find a verb when it looked at the 
remaining sentence, "on the cake, 1 ' Sy going through the cutting loop again, it 
would find the proper subject, "the typewriter," and would continue through the 
senteace* 

Once a CUT point ti&s been set for any active node* no descendant of that 
nude can extend beyond that point until the CUT Is aoved. Whenever a RftpGiyutHJlR 
program is called, tbs variable i^D la eat to the currant CUT point of the node 
which called it* The CUT point for each oonstituent is initially set to its 
EKD. When the function PARSE ie called for a word, it first checks to sac If 
the current CUT has been reached, and If so it falls. The third branch in a 
three-direction branch statement is taken if the current CUT point has been 
reached. The CUT pointer is set with the function CUT of one argument,. 
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III,5 Messages 

To write good parsing programs,. we nay at times vast to know why a 
particular PfiOSRAMMAR program failed, or why a certain pointer command canid not 
be carried out. In order to facilitate this, two message variables are kept at 

the top level of the system, ME3, and MSS?, Messages can be put on ME£ in two 

ways, either bar using the special failure directions in the branch statements 
(see section 11,6) or by using the functions M and MQ, which are exactly like I 
and fQ, except they put the Indicated feature onto the message list ME for that 

unit, When a unit returns either failure or success, KE$ is bound to the 

current value of ME, so the calling prograu can receive an arbitrary list of 

■ J. 

messages for whatever purpose it aay “ant them* MESP always contains the lest 
failure message received fron ** or *. 





► 


PiKttRAMMWl HI *6 page 




Each node is actually a list structure with the following information: 




FI th# list of features associated with the node 

S3 the place in the Sentence where the constituent begins 

A the place 1 mined lately after the constituent 

7 I 

'A the subtree below that node {actually a list of Its daughters 

in reverse order t so that il points to the last 
constituent parsed) 

SM a space reserved for semantic information 


) These can be used in two ways. If evaluated as variables* they will 

always return the designated Information for the currently active node* C Is 
always a pointer to that node. If used as functions Of One argument, they gi 
the appropriate values fur the node pointed to hr that argument; so {.'IB H) 
gives the location in the sentence of the first word of the last constituent 
parsed, while {F£{K£ Ft)} would give the feature list of that word* 

Each word in the sentence is actually a list structure containing the 4 

its he; 


FI 

SMVOBD 


TOHD 


aaaf ■ 

) 


as above 

the semantic definition of the word [see section 111*5} 
the word itself {a pointer to &□ atom) 
the root of the word [e.g,. run if the uord is 
"running”). 
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III YtriaOles Maintained by Che System 

There are two types of variables, thoae bouud at the top level* and those 
which are rebound every time a ?RGGRARHAR program is called, 

Variables bound at the top level 


H 

Always points to nett word in the sen tapea to be parsed 

SfiKT 

Always points to the entire sentence 

PT PTW 

Tree and sentence pointers* 

See Section III*G 

MES ME5P 

List of messages passed up from lower levels* 

Bee Section III.9 


Special variables bound at each level 


c fe m SM S 

Bee section 111,2 

m CUT E’£j 

See section IH,9, PtS always equals (?fOT(iQ CUT EHO)) 

MIT 

the name of the currently active FR05RAMKAR program 

RS3T - 

the list of arguments for the call to PARSE 

tThese form the initai feature list for the node, 

hut as other features are added* REST continues 

to hold only the original ones*) 

T1 T£ 13 

Three temporary PfiOG variables for use 

by the PKOGRAMMAR program In any way needed* 

KTE 

Bound only when a CLAUSE is parsed 

need as a pointer to the aain verb 

Xfi 

List of messages to be passed up to nett level 

„ _ \s 


See Section 111*9 
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III,3 Pointers 

The system always maintalas two pointers* FT to a place on the parsing 
tree, and PPM to a place In the sentence* These are moved by the functions * 
and ** respectively, as explained in sectioE 11 *7* The instructions for FT are; 


C 

P 

is 

QL 

D1C 

II 

DF 

PV 

MX 

U 

a 


set FT to the currently active node 
fat PT to the most recent (rIgiittust) daughter of C 
(down-last) nove PT to the rightmost daughter of its 
current value 

{dovn-l&st co apis tad) like DiL, except it only moves to nodes which 
are not on the push-dowu list of active nodes* 

I 

(down-first) like Dl, except the leftmost 
(previous) meve PT to its left-adjacent sister 
(next) move FT to its right-adjacent sister 
{up) move PT to the parent node of Its current valne 
Move PT to Che next word la the sentence to he parsed 


The pointer FTV always points to a pIsce in the sentence. It it moved by 
the function ** which has the same syntax as *, and the cossands; 

It 
SV 

l V 

AM 


Set PT¥ to the next word, in the sentence to he parsed 


{first-word) set 


to the first word of the constituent 


pointed to hv PT 
(last-word) like F¥ 


n 


(after-word) like fw, but first word after the constituent 
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Htf {next-word) Set PTV to the next word after Its current value 

?<f (pre» leus-wo rd} like Hlf 

spy toent*nce-firet-word) set PTV to the first word in the s entente 

SLW t seateace=-las t-*dord) like Si'll 

Since the pointers are bound at the top level, a program which calls others 
which move the pointers may want to preserve their location* PTtf is a stuple 
variable„ and can be saved with a SETS, hut PT operates by keeping, track of the 
way it has been moved* in order to be able to retrace its steps* This is 
ntcsSe&fy since LlSf lists are threaded in only one direction (in this case, 
froa the parent node to its daughters,, and frodi a right sister to its left 
sister)* The return path is bound to the variable PTR t and the command (PTSV X) 
saves the values of both PT and PTR under the variable X, while tPTSS X) 
restores both values* 
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) 

II £*9 Feature Man i p« la ting 

As explained in section IT* 1 ?* we nust be able to attach features to nodes 
in the tree. The functions F, FQ., and TRHSF are used for putting features onto 
the current node, while A and HQ remove theta, (f a) sets the feature list TiL to 
the union of its current value with the list of features A, (FQ A) aids the 
single feature A £i«e, it quotes its arsuuent). (TRUST A B) was eiplaiuei In 
Section II*?, E and HQ are inverses of P and FQ, The functions IS* ISQ, CQ* 
and RQ are used to examine features* If A points to a node of the tree or word 
of the sentence, and B points to a feature* (IS A B) returns non-nil if that 
nodYhas that feature. (ISQ A.B) is equivalent to (IS A (qpQTfi B)) p (CQ is 
the sane as [ISQ t B) (where C always points to the currently active node), and 
(HQ B) is the same as {L3Q ft BKft always points to the next word in the sentence 

j 

left to he parsed), 
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IT Examples of Sentences Parsed 


This section demonstrates the use of PROGRAH W A Ji on two English sentences. 
They were parsed using the current English graaaar for the syatea* In the 
examples J a number of features are used* It is difficult to explain their 
significance without a thorough explanation of the systems from which the 
features were selected. This grammar *ill he fully explained in a forthcoming 
paper* 

The form of input to PflioGftjW&R Is the sentence dn normal orthography and 
punctuation. The actual console dialogue U reproduced, with the inputs 
underlined, The function KALLP Is one of a nuaber of functions used to examine 
the parsing tree from the console. It prints out a representation of the tree 
in a readable form. In normal use, after finishing the parsing,. PROG HAtf HAR 
would continue with semantic analysis* For use without semantics, it baits tc 
allow the user tc examine the results, 

(PROGRAMMER) 

RHADY/ 

flow HAM EGGS MML 0 YOU HAVE BESS CVJlflG TO 'JSS I-I THE CMJS IF TQCT HAM'T 
TS'lli HQTWKj'S Rj^:?a tf AS JfKUE.? 

«os 

LISTEMIMS 


IWATLLP C\ 
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■ 



(((HD It Wtf EGGS WOULD YOU HAVE BEES GO IMG TO USE IN THE 

CME IF TOO HADN'T LBARKED YOUR MOTHER'S RECIPE it AS WROliK) 
(CLAUSE MAJOR QUEST HGQlTSS POLR2 ACT? OBJ IQ TRAHS) 

(((HOW KART E&G3} («£ QUEST HOWtART EIDEE HPL DHT) 

({HOW (QflET)) . 

(KMY (qDST >) 

(EG&S (H HPL}})} 

(WOULD (VB ADI MODAL QMTjC)) 

((YOU) (KG SU2J DEE H$ N?L) ((YOU (PROS HPL SS $UBJ OBJ)}}) 
((HAVE BEEN CO ISC TO USE) (TO MODAL NAG ft (PUT PAST MODAL}} 

((WOULD (YB AUX H0DAL Qm)) 

(HATE (HAVE VB AUX VO TStilsIS) > 

(REE A (AUX VH BE Eh)) 

(GOING (Vfi ITEMS IMG)) 

(SO (SO)) 

(Ut$EP(Y3 VO TRAHS MVB)))) 


((IN THE CAEE) (PTtEPO) 

t(IN (PLACE PREP PLACE!) 

({THE CAKE)(MG OBJ DET HS DEF) 

((THE (DET HPL HS DEE}} 

[Cm (tt (IS)))))) 

((IF YOU HADN'T LEARNED YOUR MOTHER'S RECIPE WAS WRONG) 

(CLAD31 BOUND DEOLAE ACTV TRASS) 

{(IF (BlfflGH)} 

{'YOU) (!te SU&J DSF NS NFL) ({YOU (PKDH flPL MS SUbJ OBJ)})) 
((HAJH'T LEARNED) (TO 7PL V3PS BEG {PAST PAST)) 

( (radh'1 (have 7B aux TRAMS PAST Vft V3PS V5S SEC)) 
(LEARSEO (7B TEAKS REPGB PAST EH KVB)))) 

((YOUR MOTHER'S RECIPE WAS ITKHC) 

(CLAUSE RSN& REPORT OBJ OBJ1 DSC LAE HE HT) 

{((YOUR MOTHER'S RECIPE) 

(ltt 3OBJ NS DBF DET POSES) 

({(YOUR MOTHER'S) { 

(HO SUBJ H$ DSP D£T POSES KISS) \ 

} {((TOUR) (MG SUBJ FOSS) 

((TOUR (PROM NPL HS SUBJ OBJ POSS)))) 

(MOTHER'S (8 US POSS)))) 
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(SECIPS (H S3)))) 

((HAS) (TC 73P5 7FS (PAST)} 

(COS (AJK 7B BE PSPS VF5 PAST M7E)})} 
((VBDJK) (ADJ&4}C0RP) ((noie (if)]}))))))) 


JtiAD'f/ 


PICK.UP AM.YTB.ItKS GEUM, fj T,EAST THREE 0? THE 310*%^. .4^-511335 

a rn M A sp^ra: fJica IS HifiSfia iflfl Ajar ahicjc or the table. 


*QK 

LISTENI rtf 


[tfALLP C} 

(((PICK OP AKTTHIKr WM /. AT LEAST THRJLB OT THE BLOCKS /, AMD EITHER 
A BOX Q& A SPEEDS WHICH IS BIGGER THAN AWT BRICE OS THE TABLE) 
{CLAUSE KAJOft IMPS ACTT TRAMS) 

{((PICK) (TO tHPEfl:) ({PICK (IPflT VB TO TSARS HVB))T) 

(UP (PRT ) ) 

(( ARTTEHMG GREEN /* AT LEAST THREE OT THE BLOCKS /, AMD EITHER 
A TOK OR A SPHEHE WHICH IS BIGGER THAN AMT ERICK OR TEsB TABLE) 

(» OBJ 0SJ1 EITHER CQKFOURE] LIST NS) 

(((ANYTHING (JHEESO (MS OBJ Q®J1 TPRJH) 

({ANTTHING (NS TFEOR)) 

(GHEES (E?)))) 

((AT LEAST THREE OF THE BLOCKS) 

(SC OBJ DBJ1 CDMPOHMT MUKD SUM HPL JET OP) 

((AT (AT)} 

(LEAST (NUWD HUHDATJ) 

(THREE (HUK)) 

({OF THE BLOCKS) 

{PREPS OF) 

({OP (PREP)) 

((THE BLOCKS) 

(MG OBJ OET SPL 13F) 

{(THE (DIT RPL Is PEF>) 

(BLOCKS (H HFL>>>>>>>> 

((A SOIL OR A SPHERE WHICH IS BIGGER THAR ART BRICK OR THE TABLE) 
(HO OBJ OBJ I COKFOKENT OR COMPOUND BOTH RS) 

(((A BOX) 

(H& OBJ OBJl COMPONENT OET MS I-OCF.i 
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((A {DET HS IND£T)) 

(UOX (U sts)))) 

{{A SPHERE VH3CS IS BIGGER THAK ART ERIC ft GM THE TABLE) 

(m OBJ OBJ I COMPOHiMT DET 315 IHDSF) 

C(A (DET SS IHOEF)) 

(SPHERE (LI US)) 

((WHICH IS BIGGER TEAM AM BRICE OH THE TABLE) 

(Clause rsq sgbrel be iht) 

( ((WHICH) {NG ELEUfD DET SPL) {(WHICH ( KPL) )) ) 

((IS) (VG V3PS (PRlS)) ({IS (AGS VB EE T3PS PRES MB)))) 
((BIGGER I HAH ART BRICK OH THE TABLE) 

(ADJC Q COMP COUPAR TEAS) 

((BIGGER (EP COMPAEt)) 

{TEAR (TRAH)) 

((ART BRICK OH TRH TABLE) 

(«G SUBJ COHFAfl DET KS ^tTFR) 

t (ANT {DET «S HPT, CflTFR)) 

(BRICK {H MS)) 

((OR THE TABLE) 

(FRSPG Q;> 

{{OH (PRHP PLACE)) 

{{THE TABLE) 

{HO OBJ DET H5 DEF) 

{ (THE (DET MPIr <TS DBF)) (TABLE (fl MS))))))))))})))>>))})) 


) 



Efcfe ranees 

* } W+ to|S ® f «* Theory of ftr &mir 

3) 


4) 


5) 


6) 


'l 
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